Method and vehicle control system for producing images of a surroundings model, and corresponding vehicle

ABSTRACT

In a method of producing images of a stored three-dimensional model of the surroundings of a vehicle, the images are corrected for perspective. A camera picture is produced by a camera device of the vehicle, and is projected onto a projection surface in the surroundings model. A region relevant for driving is marked in the surroundings model and is projected onto a corresponding projection surface area of the projection surface. An image of the projection surface including the driving-relevant region projected onto the projection surface area is produced and output by a virtual camera that can move freely in the surroundings model.

FIELD OF THE INVENTION

The invention relates to a method for producing images of a storedthree-dimensional surroundings model, said images having been correctedfor perspective, a vehicle control system of a vehicle for producingimages of a stored three-dimensional model of the surroundings of thevehicle, said images having been corrected for perspective, and avehicle having a vehicle control system.

BACKGROUND INFORMATION

Surroundings models like those known, for example, from WO 2013/060323A1 can help the driver or a driver assistance system to control thevehicle. A parking assist system can, for example, display a camerapicture to the driver on a display, the expected trajectory of thevehicle being drawn in by means of auxiliary lines in said camerapicture. It is enormously important that these auxiliary lines are alsodisplayed at the correct location in the event of the camera alignmentbeing altered, in order to prevent the driver wrongly estimating thevehicle movement and colliding with objects.

SUMMARY OF THE INVENTION

It is therefore an object of the invention to provide images of asurroundings model, in which regions relevant for driving are drawn incorrectly.

This object can be achieved by a method for producingperspective-corrected images of a stored three-dimensional model of thesurroundings of a vehicle, a vehicle control system for producingperspective-corrected images of a stored three-dimensional surroundingsmodel, and a vehicle, respectively having features according to variousaspects of the invention as set forth herein.

According to a first aspect, the invention accordingly relates to amethod for producing images of a stored three-dimensional model of thesurroundings of a vehicle, said images having been corrected forperspective. At least one camera picture is produced by a camera deviceof the vehicle and the produced camera picture is projected onto aprojection surface in the stored three-dimensional model of thesurroundings of the vehicle. A region relevant for driving is marked insaid stored three-dimensional surroundings model. The method furthercomprises the projecting of the marked region onto a correspondingprojection surface area of the projection surface, in order to identifyan image region of the camera picture projected onto the projectionsurface corresponding to the marked region as having been corrected forperspective. An image of the projection surface with the regionprojected onto the projection surface area is produced by means of avirtual camera that can move freely in the surroundings model, and theproduced image is output.

The term ‘vehicle’ denotes, in particular, a motor vehicle, inparticular a car, a motorcycle, an E-bike, a truck, a ship or boat oreven an airplane.

The term ‘image of the surroundings model’ denotes an image of aparticular spatial partial region of the surroundings model produced bymeans of the virtual camera, wherein the image depends on a position andalignment of the virtual camera.

The term ‘projection surface’ denotes a two-dimensional hypersurface inthe three-dimensional surroundings model, which can be shaped and curvedin any way desired. The projection surface can be a flat plane, aspherical shell segment, a cylindrical surface or a paraboloidal orhyperboloidal face.

The term ‘region relevant for driving’ denotes a region of thesurroundings model, which corresponds to a real spatial region of thesurroundings of the vehicle, which is important for navigating thevehicle. The real spatial region can, for example, be a spatial area, inwhich objects or obstacles which are impassable for the vehicle arelocated. The real spatial region can also correspond to a trajectory ofthe vehicle, along which the vehicle would move without the drivingparameters being altered. The real spatial region can further be aparticular range of distance from the vehicle or correspond to a parkingspace. The real spatial region can be a zero-dimensional dot-shapedregion, a one-dimensional, in particular also a curved, linear region, atwo-dimensional, possibly curved surface, or a three-dimensional volumeregion.

The fact that the marked region is projected directly onto theprojection surface area of the projection surface means that this isdirectly identified in the camera picture projected onto the projectionsurface. If the viewing direction onto the projection surface is changeddue to the movement of the virtual camera, the projection surface areanevertheless remains at the correct position such that aberrationeffects can be prevented. Such perspective errors are consequentlycorrected by the method according to the invention.

The method according to the invention improves the representation of theregion relevant for driving. Thus, it is only possible for the vehicle'sdriving function to be controlled by a driver assistance system on thebasis of the produced images once the images have been corrected forperspective since, otherwise, wrongly drawn-in regions relevant fordriving could be evaluated. The method consequently improves theprecision and accuracy of the produced images and therefore also largelyincreases safety, since the images have of course been corrected forperspective and are free of perspective errors.

According to one preferred embodiment of the method, the marked regionis projected onto the projection surface, in that a respective point ofthe marked region is imaged onto an intersection of a correspondingconnecting line with the projection surface, wherein the connecting lineconnects this point of the marked region to a predefined reference pointof the surroundings model. The reference point consequently designates apossible position of the movable virtual camera, viewed from which theregion relevant for driving is projected onto the projection surface bycentral projection. The projection surface preferably lies between thereference point and the region relevant for driving, however the regionrelevant for driving can also be located between the reference point andthe projection surface.

According to one preferred further development of the method, the cameradevice has at least one vehicle camera, wherein the reference point ofthe surroundings model corresponds to a spatial position of that vehiclecamera which produces the camera picture imaged onto the projectionsurface. Consequently, it is ensured that, due to the projecting of themarked region, said marked region is drawn in at the correct location ofthe projection surface, since an image produced from the perspective ofthe reference point reflects the real conditions with the regionrelevant for driving located at the correct position.

According to one preferred further development of the method, a cameraposition and/or camera alignment of the freely movable virtual camerais/are determined on the basis of sensor data produced by sensors of thevehicle and/or captured parameters of the vehicle. Thus, for instance inhazardous situations such as during reversing or when turning into anunclear road, the position of the virtual camera can be automaticallycontinually moved, in order to consequently output images from a viewingdirection which is convenient for the driver or which can be easilyevaluated by the driver assistance system. Possible vehicle parametersare the speed or position of the vehicle or an angular position of thewheels of the vehicle.

According to one preferred embodiment of the method, a driver assistancesystem controls a function of the vehicle on the basis of the outputimages. The vehicle functions can comprise actuating and enabling ordisabling actuators such as, for instance, indicators or side mirrors,or also semi-autonomous or autonomous acceleration, braking or steeringof the vehicle.

According to one preferred embodiment of the method, the output imagesare displayed to a driver of the vehicle on a display apparatus. Thistherefore provides the driver with an accurate overview of the vehiclesurroundings, wherein regions relevant for driving are drawn incorrectly in terms of perspective.

According to one preferred further development of the method, the regionrelevant for driving is marked in the stored three-dimensionalsurroundings model on the basis of sensor data produced by sensors ofthe vehicle and/or captured parameters of the vehicle. For example,distances of objects can be measured on the basis of radar sensors and,as a result, regions relevant for driving of the surroundings model,which correspond to spatial regions occupied by objects, are identified.

According to a further aspect, the invention comprises a vehicle controlsystem of a vehicle for producing images of a stored three-dimensionalmodel of the surroundings of the vehicle, said images having beencorrected for perspective. The vehicle control system comprises a cameradevice which is configured to produce at least one camera picture, aswell as a computing device. The computing device is configured toproject the produced camera picture onto a projection surface in thestored three-dimensional model of the surroundings of the vehicle, tomark a region relevant for driving in the stored three-dimensionalsurroundings model, and to project the marked region onto acorresponding projection surface area of the projection surface. Thecomputing device is consequently configured to identify an image regionof the camera picture projected onto the projection surfacecorresponding to the marked region as having been corrected forperspective. The computing device is further configured to produce animage of the projection surface with the region projected onto theprojection surface area by means of a virtual camera that can movefreely in the surroundings model, and to output the produced image.

According to one further development of the vehicle control system, thecomputing device is further configured to project the marked region ontothe projection surface, in that it images a respective point of themarked region onto an intersection of a corresponding connecting linewith the projection surface, wherein the connecting line connects thispoint of the marked region to a predefined reference point of thesurroundings model.

According to one preferred further development of the vehicle controlsystem, the camera device has at least one vehicle camera, wherein thereference point of the surroundings model corresponds to a spatialposition of that vehicle camera which produces the camera picture imagedonto the projection surface.

According to one further embodiment, the vehicle control systemcomprises at least one sensor of the vehicle, which is configured toproduce sensor data and/or to capture parameters of the vehicle. Thecomputing device is configured to mark the region relevant for drivingin the stored three-dimensional surroundings model on the basis of theproduced sensor data and/or on the basis of the captured parameters ofthe vehicle.

According to one further embodiment of the vehicle control system, thecomputing device is configured to determine a camera position and/orcamera alignment of the freely movable virtual camera on the basis ofthe produced sensor data and/or on the basis of the captured parametersof the vehicle.

According to one preferred embodiment, the vehicle control system has adriver assistance system which is configured to control a function ofthe vehicle on the basis of the output images.

According to one preferred embodiment of the vehicle control system, theoutput device has a display apparatus, on which the output images can bedisplayed to a driver of the vehicle.

According to a third aspect, the invention provides a vehicle having avehicle control system.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is explained in greater detail below on the basisof the embodiment examples indicated in the schematic figures of thedrawings, wherein:

FIG. 1 shows a flow chart in order to explain a method for producingimages of a stored three-dimensional surroundings model of a vehicle,said images having been corrected for perspective, according to oneembodiment of the invention;

FIG. 2 shows a top view of an exemplary scenario in order to explain themethod according to the invention;

FIG. 3 shows a schematic view of a surroundings model in order toexplain the projecting of a marked region;

FIG. 4 shows an exemplary image from a first camera perspective;

FIG. 5 shows a view of a surroundings model in order to explain theaberration effect avoided by the invention;

FIG. 6 shows an image having an aberration error;

FIG. 7 shows a schematic view of the surroundings model having a virtualcamera that can move freely;

FIG. 8 shows an exemplary image from a second camera perspective;

FIG. 9 shows a schematic block diagram in order to explain a vehiclecontrol system according to one embodiment of the invention; and

FIG. 10 shows a schematic block diagram of a vehicle according to oneembodiment of the invention.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS OF THE INVENTION

In all of the figures, similar elements and apparatuses or respectivelyelements and apparatuses having similar functions are provided with thesame reference numerals. The method steps are numbered for reasons ofclarity. This is not, in general, intended to imply a specific temporalsequence. In particular, multiple method steps can be carried outsimultaneously. Furthermore, various embodiments can be combined witheach other at will, inasmuch as this makes sense.

FIG. 1 shows a flow chart in order to explain a method for producingimages of a stored three-dimensional surroundings model of a vehicle,said images having been corrected for perspective, according to oneembodiment of the invention.

In FIG. 2, an exemplary scenario is illustrated in a top view whichshows a vehicle 20 which is equipped with a camera device 21 which hasvehicle cameras 21 a-21 d mounted around the vehicle. Boundary posts 24as well as further road users 22, 23 are located in the surroundings ofthe vehicle 20.

In a first method step S1, at least one camera picture of thesurroundings of the vehicle 20 is produced by the camera device 21 ofthe vehicle 20.

A three-dimensional model 30 of the surroundings of the vehicle 20 isfurther provided, which is schematically illustrated in FIG. 3. Thethree-dimensional surroundings model is preferably stored in a memory ofa vehicle control system of the vehicle 20. A projection surface 31,which is for example arranged cylindrically around an origin ofcoordinates 36 of the surroundings model 30, is determined in thesurroundings model 30, wherein the origin of coordinates 36 correspondsto a position of the vehicle 20. The projection surface 31 can alsocorrespond to a spherical surface arranged around the origin ofcoordinates 36 or a partial region of a spherical surface. The shape ofthe projection surface is not limited to the indicated examples.

In a second method step S2, the produced camera picture 32 is projectedonto the projection surface 31.

In a further method step S3, a region 33 relevant for driving is markedor identified in the stored three-dimensional surroundings model. Themarking or identifying S3 is preferably carried out automatically, inparticular on the basis of sensor data and/or parameters of the vehicle,which are preferably produced or respectively established by at leastone sensor of the vehicle 20. Thus, a region 33 relevant for driving,which corresponds to an expected trajectory of the vehicle 20, is, forexample, determined on the basis of an angular position of the wheels ofthe vehicle measured by the at least one vehicle sensor, and marked oridentified in the surroundings model. For example, the region 33relevant for driving can be marked or identified with color in thesurroundings model. A reference point 34 of the surroundings model 30 isfurther marked or identified, which corresponds to a spatial position ofthat vehicle camera which produces the camera picture 32 imaged onto theprojection surface 31.

With respect to this reference point 34, the marked or identifiedrelevant region 33 that is relevant for driving is projected onto acorresponding projection surface area 35 of the projection surface 31 ina further method step S4. The projection surface area 35 is an imageregion of the camera picture projected onto the projection surface,which corresponds to the marked or identified relevant region 33, whichis consequently marked in a perspective-corrected manner. To this end,an intersection 39 of the projection surface 31 with a connecting line38 is determined for each point 37 of the marked or identified relevantregion 33, wherein the connecting line 38 connects this point 37 to thereference point 34.

In a further method step S5, an image of the projection surface 31 isproduced with the region 33 projected onto the projection surface area35 by means of a virtual camera that can move freely in the surroundingsmodel 30, and the produced image is output in a subsequent method stepS6.

FIG. 4 shows a produced first image 40 which is acquired by means of avirtual camera located at the reference point 34. Here, the markedregion 33 relevant for driving is located at the correct position anddisplays a trajectory, along which the vehicle will move if it retainsits driving parameters, to the driver of the vehicle 21.

A fundamental point of the invention is that the region relevant fordriving is projected onto the projection surface and the projectionsurface with the region projected onto the projection surface area isimaged. This differs from the image which would be produced by acquiringthe projection surface and the region relevant for driving itself.

By way of comparison, such a method is illustrated in FIG. 5 but is notpart of the invention. If the virtual camera is displaced from thereference point 34 to a predefined camera spatial point 54, said cameracaptures a picture of the projection surface 31 as well as the markedregion 33 relevant for driving, the region 33 relevant for drivingappears in a corresponding image at a displaced position 55 of theprojected camera picture 32. This is illustrated in FIG. 6 which shows asecond image 60 which is acquired with this method and which is notcomprised by the invention. It can be seen that, during thisdisplacement of the virtual camera to the camera spatial point 54, adisplacement of the imaged region 33 relevant for driving does notcorrespond to a displacement of the image section itself. Due to thisaberration effect, the trajectory of the vehicle is not displayedcorrectly in the indicated example.

In contrast thereto, FIG. 7 explains the producing of images of theprojection surface 31 with the region 33 projected onto the projectionsurface area 35 according to the invention. Here, a virtual camera 72 isdrawn in by way of example at the reference point 34 and at a furthercamera spatial point 71. Irrespective of a camera position of thevirtual camera 72 and of an alignment of the virtual camera 72, theprojection surface area 35 always appears at the same, i.e. the correct,position of the camera picture 32 on the projection surface 31.

FIG. 8 shows, by way of example, a third image 80 which has beenacquired by means of the virtual camera 72 at the further camera spatialpoint 71. As can be seen, the region 33 relevant for driving is now, inturn, located at the right position of the produced image.

As a result, the method makes it possible to correct the perspective ofthe image by preventing an aberration effect.

According to one further embodiment, the camera position and/or cameraalignment of the freely movable virtual camera 72 is/are determined onthe basis of sensor data produced by sensors of the vehicle 20 and/orparticular parameters of the vehicle 20. The camera position of thevirtual camera can thus be continually and uniformly displaced, andappropriate continual images can be produced.

According to one embodiment, the produced images are output to a driverassistance system which controls a function of the vehicle on the basisof the output images. For example, an advantageous camera view for thedriver assistance system can be selected, which is distinguished by anoptimum perspective view, as a result of which the required computingtime and computing performance of the driver assistance system forevaluation can be reduced. Starting from this camera perspective, thedriver assistance system can control the vehicle partially autonomouslyor autonomously. It is only possible for the driver assistance system tocontrol the vehicle precisely, if the regions relevant for driving aredrawn in correctly.

According to one preferred further development, the output images aredisplayed to a driver of the vehicle 20 on a display apparatus of thevehicle 20.

FIG. 9 shows a block diagram in order to explain a vehicle controlsystem 90 of a vehicle 20 for producing images of a storedthree-dimensional model of the surroundings 30 of the vehicle 20, saidimages having been corrected for perspective. The vehicle control system90 has a camera device 21 which is configured to produce at least onecamera picture 32. The camera device 21 can comprise a multitude ofvehicle cameras 21 a-21 d which allow a surround view of the environmentof the vehicle 20. The vehicle control system further has a storagedevice, on which a three-dimensional model of the surroundings of thevehicle 20 is stored. According to one further embodiment, thethree-dimensional surroundings model 30 can also be made available tothe vehicle control system by means of an interface.

The vehicle control system 90 comprises a computing device 91 which isconfigured to project the produced camera picture onto a projectionsurface 31 in the stored three-dimensional surroundings model of thevehicle. The projection surface 31 can be predefined or can bedetermined by the computing device 91 itself.

The computing device 91 is further configured to mark a region relevantfor driving in the stored three-dimensional surroundings model. To thisend, the vehicle control system 90 can optionally have at least onevehicle sensor 93 which is configured to produce sensor data and/orcapture parameters of the vehicle 20. Such vehicle sensors 93 compriseradar systems, lidar systems, optical cameras, infrared cameras or lasersystems. The region relevant for driving which corresponds, for example,to a parking space, a trajectory of the vehicle or an obstacle, can berecognized on the basis of the sensor data by the computing device 91and recorded and marked in the surroundings model 30.

The computing device 91 is further configured to project the markedregion 33 onto a corresponding projection surface area 35 of theprojection surface 31. As a result, the computing device 91 identifiesan image region of the camera picture 32 projected onto the projectionsurface 31 corresponding to the marked area 32 in a way which indicatesit has been corrected for perspective. The computing device 91 isfurther configured to produce an image of the projection surface withthe region 33 projected onto the projection surface area 35 by means ofa virtual camera 72 that can move freely in the surroundings model 30.

The vehicle control system 90 further has an output device 92 which isconfigured to output the produced image. The output device 92 can havean interface, in particular a cable connection, a USB interface or awireless interface. The produced images can, in particular, betransmitted by means of the output device 92 to further units or viacar-to-car communication to further vehicles.

Optionally, the vehicle control system 90 further comprises a driverassistance system 94 which is configured to control a function of thevehicle 20 on the basis of the output images.

According to one preferred further development, the output device 92 hasa display apparatus which is arranged in an interior of the vehicle 20and displays the output images to a driver of the vehicle 20.

FIG. 10 shows an exemplary block diagram of a vehicle 20 having avehicle control system 90 according to one embodiment of the invention.Here, the vehicle control system 90 can be one of the embodimentsindicated above.

LIST OF REFERENCE NUMERALS

20 Vehicle

21 Camera device

21 a to 21 d Vehicle cameras

22, 23 Further road users

24 Boundary posts

30 Surroundings model

31 Projection surface

32 Camera picture

33 Region relevant for driving

34 Reference point

35 Projection surface area

36 Origin of coordinates

37 Point of the marked region

38 Connecting line

39 Intersection

40 First image

54 Camera spatial point

55 Displaced position

60 Second image

71 Further camera spatial point

72 Virtual camera

80 Third image

90 Vehicle control system

91 Computing device

92 Output device

93 Vehicle sensors

94 Driver assistance system

The invention claimed is:
 1. A method of producing images of a storedthree-dimensional surroundings model of surroundings of a vehicle, saidimages having been corrected for perspective, comprising the steps:producing at least one camera picture of the surroundings by a cameradevice of the vehicle; projecting the camera picture onto a projectionsurface in the surroundings model; in the surroundings model,identifying a relevant region that is relevant for driving, wherein theidentifying of the relevant region includes marking the relevant regionin the surroundings model with a line or a color that is synthesized inthe surroundings model and does not exist in the at least one camerapicture of the surroundings so as to produce a marked relevant region inthe surroundings model; projecting the marked relevant region of thesurroundings model, including the line or the color with which therelevant region has been marked, onto a corresponding projection surfacearea of the projection surface onto which projection surface the camerapicture is also projected, so as to superimpose the marked relevantregion and the camera picture with one another on the projection surfaceand thereby to mark a perspective-corrected image region of the camerapicture that is projected onto the projection surface, wherein themarked perspective-corrected image region corresponds to the markedrelevant region as having been corrected for perspective; producing avirtual camera image of the marked relevant region and the camerapicture superimposed with one another on the projection surface so as torepresent the marked perspective-corrected image region in the virtualcamera image, by a virtual camera that can move freely in thesurroundings model; and outputting the virtual camera image.
 2. Themethod according to claim 1, wherein the projecting of the markedrelevant region onto the projection surface area comprises respectivelyimaging a respective point of the marked relevant region onto anintersection of a corresponding respective connecting line with theprojection surface, wherein the respective connecting line connects therespective point of the marked relevant region to a predefined referencepoint of the surroundings model.
 3. The method according to claim 2,wherein the camera device comprises at least one vehicle camera, andwherein the reference point of the surroundings model corresponds to aspatial position of the vehicle camera that produced the camera picture.4. The method according to claim 1, further comprising determining acamera position and/or a camera orientation of the virtual camera basedon sensor data produced by sensors of the vehicle and/or based ondetected vehicle parameters of the vehicle.
 5. The method according toclaim 1, further comprising controlling a vehicle function of thevehicle with a driver assistance system based on the output virtualcamera image.
 6. The method according to claim 1, further comprisingdisplaying the output virtual camera image to a driver of the vehicle ona display apparatus.
 7. The method according to claim 1, wherein theidentifying of the marked relevant region in the surroundings model isperformed based on sensor data produced by sensors of the vehicle and/orbased on detected vehicle parameters of the vehicle.
 8. The methodaccording to claim 1, further comprising performing the method in avehicle control system of the vehicle, and providing the surroundingsmodel to the vehicle control system from outside of the vehicle controlsystem via an interface.
 9. A vehicle control system of a vehicle forproducing images of a stored three-dimensional surroundings model ofsurroundings of the vehicle, said images having been corrected forperspective, comprising: a camera device configured to produce at leastone camera picture of the surroundings; a computing device configured:to project the camera picture onto a projection surface in thesurroundings model, to identify, in the surroundings model, a relevantregion that is relevant for driving, by marking the relevant region inthe surroundings model with a line or a color that is synthesized in thesurroundings model and does not exist in the at least one camera pictureof the surroundings so as to produce a marked relevant region in thesurroundings model, to project the marked relevant region of thesurroundings model, including the line or the color with which therelevant region has been marked, onto a corresponding projection surfacearea of the projection surface onto which projection surface the camerapicture is also projected, so as to superimpose the marked relevantregion and the camera picture with one another on the projection surfaceand thereby to mark a perspective-corrected image region of the camerapicture that is projected onto the projection surface, wherein themarked perspective-corrected image region corresponds to the markedrelevant region as having been corrected for perspective, and to producea virtual camera image of the marked relevant region and the camerapicture superimposed with one another on the projection surface so as torepresent the marked perspective-corrected image region in the virtualcamera image, by a virtual camera that can move freely in thesurroundings model; and an output device configured to output thevirtual camera image.
 10. The vehicle control system according to claim9, wherein the computing device is further configured so that theprojecting of the marked relevant region onto the projection surfacearea comprises respectively imaging a respective point of the markedrelevant region onto an intersection of a corresponding respectiveconnecting line with the projection surface, wherein the respectiveconnecting line connects the respective point of the marked relevantregion to a predefined reference point of the surroundings model. 11.The vehicle control system according to claim 10, wherein the cameradevice comprises at least one vehicle camera, and wherein the referencepoint of the surroundings model corresponds to a spatial position of thevehicle camera that produced the camera picture.
 12. The vehicle controlsystem according to claim 9, further comprising at least one sensor ofthe vehicle configured to produce sensor data and/or to detect vehicleparameters of the vehicle; wherein the computing device is furtherconfigured so that the identifying of the marked relevant region in thesurroundings model is performed based on the sensor data and/or based onthe detected vehicle parameters of the vehicle.
 13. The vehicle controlsystem according to claim 12, wherein the computing device is furtherconfigured to determine a camera position and/or a camera orientation ofthe virtual camera based on the sensor data and/or based on the detectedvehicle parameters of the vehicle.
 14. The vehicle control systemaccording to claim 9, further comprising a driver assistance systemconfigured to control a vehicle function of the vehicle based on theoutput virtual camera image.
 15. The vehicle control system according toclaim 9, wherein the output device comprises a display apparatusconfigured to display the output virtual camera image to a driver of thevehicle.
 16. A vehicle comprising a vehicle control system according toclaim 9, and a vehicle body.
 17. The vehicle according to claim 16,wherein the vehicle is an airplane and the vehicle body comprises anairplane fuselage.
 18. A method comprising the steps: a) with a camerasystem of a vehicle, producing a real camera picture of surroundings ofthe vehicle; b) providing a stored three-dimensional surroundings modelof the surroundings of the vehicle; c) projecting the real camerapicture onto a virtual projection surface; d) in the surroundings model,identifying a relevant region that is relevant for driving of thevehicle, wherein the identifying of the relevant region includes markingthe relevant region in the surroundings model with a line or a colorthat is synthesized in the surroundings model and does not exist in theat least one camera picture of the surroundings so as to produce amarked relevant region in the surroundings model; e) projecting themarked relevant region of the surroundings model, including the line orthe color with which the relevant region has been marked, onto thevirtual projection surface that also has the real camera pictureprojected thereon, so as to superimpose the marked relevant region andthe real camera picture with one another on the virtual projectionsurface; f) with a virtual camera that is freely movable to differentvirtual camera positions relative to the virtual projection surface, ata selected one of the virtual camera positions producing a virtualcamera image of the virtual projection surface having the real camerapicture and the marked relevant region projected and superimposed withone another thereon; and g) outputting the virtual camera image.
 19. Themethod according to claim 18, further comprising automaticallycontrolling a vehicle function in response to and dependent on theoutput virtual camera image.
 20. The method according to claim 18,further comprising moving the virtual camera to a different one of thevirtual camera positions in response to and dependent on sensor dataproduced by at least one sensor of the vehicle or vehicle parameters ofthe vehicle, and then repeating the steps a) to g) with the virtualcamera at the different virtual camera position for the step g).